Using Hybrid Artificial Bee Colony Algorithm and Particle Swarm Optimization for Training Feed-forward Neural Networks
نویسندگان
چکیده
The Artificial Bee Colony Algorithm (ABC) is a heuristic optimization method based on the foraging behavior of honey bees. It has been confirmed that this algorithm has good ability to search for the global optimum, but it suffers from the fact that the global best solution is not directly used, but the ABC stores it at each iteration, unlike the particle swarm optimization (PSO) that can directly use the global best solution at each iteration. So the hybrid of artificial bee colony Algorithm (ABC) and PSO resolved the aforementioned problem. In this article, Hybrid ABC and PSO is used as new training method for Feedforward Neural Networks (FFNNs), in order to get rid of imperfections in traditional training algorithms and get the high efficiencies of these algorithms in reducing the computational complexity and the problems of Tripping in local minima, also reduction of slow convergence rate of current evolutionary learning algorithms. We test the accuracy of our proposal using FFNNs trained with ABC, PSO, and Hybrid ABC and PSO. The experimental results show that ABCPSO outperforms both ABC and PSO for training FFNNs in terms the aforementioned Imperfections.
منابع مشابه
Training Feed-Forward Neural Networks Using Firefly Algorithm
In this work, firefly algorithm (FA) is used in training feed-forward neural networks (FNN) for classification purpose. In experiments, three well-known classification problems have been used to evaluate the performance of the proposed FA. The experimental results obtained by FA were compared with the results reported by artificial bee colony (ABC) algorithm and genetic algorithm (GA). Also, si...
متن کاملTraining of Feed-Forward Neural Networks for Pattern-Classification Applications Using Music Inspired Algorithm
There have been numerous biologically inspired algorithms used to train feed-forward artificial neural networks such as generic algorithms, particle swarm optimization and ant colony optimization. The Harmony Search (HS) algorithm is a stochastic meta-heuristic that is inspired from the improvisation process of musicians. HS is used as an optimization method and reported to be a competitive alt...
متن کاملNovel Multi-Objective Artificial Bee Colony Optimization for Wrapper Based Feature Selection in Intrusion Detection
This study proposes a novel approach based on multi-objective artificial bee colony (ABC) for feature selection, particularly for intrusion-detection systems. The approach is divided into two stages: generating the feature subsets of the Pareto front of non-dominated solutions in the first stage and using the hybrid ABC and particle swarm optimization (PSO) with a feed-forward neural network (F...
متن کاملArtificial Bee Colony Training of Neural Networks
The Artificial Bee Colony (ABC) is a recently introduced swarm intelligence algorithm for optimization, that has previously been applied successfully to the training of neural networks. This paper explores more carefully the performance of the ABC algorithm for optimizing the connection weights of feed-forward neural networks for classification tasks, and presents a more rigorous comparison wit...
متن کاملTraining neural networks with ant colony optimization algorithms for pattern classification
Feed-forward neural networks are commonly used for pattern classification. The classification accuracy of feed-forward neural networks depends on the configuration selected and the training process. Once the architecture of the network is decided, training algorithms, usually gradient descent techniques, are used to determine the connection weights of the feed-forward neural network. However, g...
متن کامل